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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 



1 L (Canceled) 



1 2. (Currently amended) The system of claim [[1]J& further comprising: 

2 a video camera coupled to said computer for providing said video images. 

1 3. (Original) The system of claim further comprising: 

2 a video digitization unit couple to said video camera and said computer for converting 

3 said video images provided by said video camera from analog to digital format. 

1 4. (Original) The system of claim 3, further comprising: 

2 a storage/retrieval unit coupled to said video digitization unit, said video camera, and said 

3 computer, for storing video images and standard object video images. 

r 

1 |5_ (Canceled) 

1 y6. (Previously presented) A system comprising: 

2 a computer configured to determine a position and shape of an object of interest from 

3 video images and to characterize activity of said object of interest based on analysis of changes 

4 in said position and said shape over time; 

5 wherein said computer includes an object identification and segregation module receiving 

6 said video images; and 
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7 wherein said object identification and segregation module operates using a background 

C\ 8 ^Subtraction algorithm in which a plurality of said video images are grouped into a set, a standard 
)£9 deviation map of the set of video images is created, a bounding box where a variation is greater 



10 than a predetermined threshold is remove from said set of video images, and the set of images 

1 1 less said bounding boxes is averaged to produce a back ground image. 

1 >T (Original) The system of claim % wherein said computer further includes a behavior 

2 identification module for characterizing activity of said object, said behavior identification 

3 module being coupled to said object identification and segregation module. 

, 5 

1 jtff (Original) The system of claim fl, wherein said computer further includes an object 

2 tracking module for tracking said object from one frame of said video images to another frame, 

3 and an object shape and location change classifier for classifying the activity of said object, 

4 coupled to each other, said object identification and segregation module, and said behavior 

5 identification module. 

1 4 jf. (Original) The system of claim^S, wherein said computer further includes a standard 

2 object behavior storage module that stores information about known behavior of a predetermined 

3 standard object for comparing the activity of said object, said standard object behavior storage 

4 module being coupled to said behavior identification module, and a standard object classifier 

5 module coupled to said standard object behavior module. 

I ;l 

1 (Currently amended) The system of claim [[5]|^, wherein said computer further includes 

2 a standard object behavior storage module that stores information about known behavior of a 
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3 predetermined standard object for comparing the activity of said object, said standard object 

4 jy/behavior storage module being coupled to said behavior identification module. 

1 f y(. (Currently amended) The system of claim [[1]|& wherein said object is a living object. 
1^ (Currently amended) The system of claim wherein said object is an animal. 

1 J ^ ^ (Currently amended) The system of claim [[1]]^ wherein said object is a mouse. 

I 

\^ (Currently amended) The system of claim [[l]]Jj[, wherein said object is a human. 

(Currently amended) The system of claim [[1]]^, wherein said object is a man made 

2 machine. 

1 ^16-17. (Canceled) ^ 

1 )^ (Currently amended) The method of claim [[16]]^, wherein said foreground object 

2 detection includes the step of generating a background image from an average of a set of 

3 individual frames of said video images. ^ 

1 l#. (Original) The method of claim 18, wherein said step of generating a background image 

2 includes the step of determining variation in intensity of pixels within said individual frames to 

3 identify a region where said foreground object is located. 

1 7 \<Oy 

1 . • 2$? (Original) The method of claim wherein said step of generating a background image 

2 further includes the step of using non-variant pixels of the video images to generate said 

3 background image. 
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\% 17 

p^. (Original) The method of claim ^wherein said step of generating a background image 
'is performed periodically to correct for changes in background objects and small movements of a 
. A3 camera capturing said video images. . 

1 2pf. (Currently amended) The method of claim [[16] ]^6, wherein said detecting a foreground 

2 object includes using a background subtraction method comprising the steps of: 

3 multiply frames in a neighborhood of current image; 

4 apply a lenient threshold on a difference between a current image and a background so as 

5 to determine a broad region of interest; 

6 classify by intensity various pixels in said region of interest to obtain said foreground 

7 object; and 

8 apply edge information to refine contours of said foreground object image. 

1 (Currently amended) The method of claim [[16]]^), wherein said step of detecting said 

2 foreground includes the step of manual identification of foreground objects to be tracked and 

3 characterized. , 

& ■ # 

1 yl. (Currently amended) The method of claim [[1 7]]?/f, wherein said posture determination 

2 and description includes using statistical and contour-based shape information. 

1 25. (Original) The method of claim ^d, wherein said step of identifying and classifying 

2 changes to said foreground object includes using statistical shape information selected from the 

3 group consisting of: 

4 area of the foreground object; 

5 centroid of the foreground object; 
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bounding box and its aspect ratio of the foreground object; 
eccentricity of the foreground object; and 
a directional orientation of the foreground object relative to an axis as generated with a 
Principal Component Analysis. 

(Original) The method of claim 1^, wherein said step of identifying and classifying 
changes to said foreground object uses contour-based shape information selected from the group 
consisting of b-spline representation, convex hull representation, and corner points. 

a* 

27\ (Original) The method of claim 24, wherein said step of identifying and classifying 
changes to said foreground object includes identifying a set of model postures and their 
description information, said set of model postures including horizontal posture, vertical posture, 
eating posture, or sleeping posture. , 

28. (Original) The method of claim wherein said step of identifying and classifying 
changes to said foreground object includes classifying changes to said foreground object includes 
classifying the statistical and contour-based shape information from a current image to assign a 
best-matched posture. 



9. (Canceled) 

3Qr. (Amended) A method of characterizing activity of an object using a computer 



composing: 



detecting a foreground object of interest in video images; 

tracking said foreground object over a plurality of said video images; 

classifying said foreground object in said plurality of video images; and 
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characterizing said activity of said foreground object based on comparison of said 

classifications to activity of a standard object; wherein said characterizing said 
activity includes: 

9 describing a sequence of postures as behavior primitives; and 

10 aggregating behavior primitives into actual behavior over a range of images; 

1 1 wherein said describing said behavior primitives further includes: 

12 identifying patterns of postures over a sequence of images; and 

13 analyzing temporal information selected from the group consisting of direction 

14 and magnitude of movement of the centroid, increase and decrease of the 

15 eccentricity, increase and decrease of the area, increase and decrease of 

16 the aspect ratio of the bounding box, change in the b-spline representation 

17 points, change in the convex hull points, and direction and magnitude of 

18 corner points. 

r 

1 31-32. (Canceled) 

1 ^6. (Currently amended) The method of claim [[17]]^j6, wherein the said step of determining 

2 actual behavior by aggregating behavior primitives includes the step of analyzing temporal 

3 ordering of the primitives, such as using information about a transition from a previous behavior 

4 primitive to a next behavior primitive. 

(Original) The method of claim ^, wherein said temporal analysis is a time-series 
2 analysis such as Hidden Markov Model (HMMs). 

1 ^ yi. (Original) The method of claim^J^fwherein the said step of determining actual behavior 

2 includes identifying actual behavior selected from a group consisting of sleeping, eating, 

3 roaming around, grooming, and climbing. 
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(Original) A method for background subtraction of a video image, comprising the steps 



2 of: 



3 grouping a number of images into a set of video images; 

4 creating a standard deviation map of the grouped images; 

5 removing a bounding box area of said image where variation is above a predetermined 

6 threshold to create a y partial image; and 

7 combining said partial image with an existing set of partial images by averaging the set of 

8 images to generate a complete background image deplete of a desired foreground object. 

/ . >/ 

1 jy y. (Original) The method of claim ^6, further comprising the step of subtracting said 

2 complete background image from a current image so a to obtain said desired foreground object. 

1 tA3fs. (Original) The method of claim 36, wherein said steps are repeated periodically to update 



2 said complete background package. 

r 

1 ^39-48 (Canceled) 
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